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CALCULATION  OF  LOWER  CONFIDENCE  BOUNDS 
ON  SYSTEM  RELIABILITY 

Joseph  V.  Michalowicz 

/ Harry  Diamond  Laboratories,  USA  ERADCOM 
Adelphi,  MD  20783 


ABSTRACT . A general  methodology,  based  on  algorithms  developed  by  the 

Ad-Hoc  Methodology  Working  Group  on  Nuclear  Weapons  Reliability  Assessment,  is 
described  for  evaluating  90Z  lower  confidence  bounds  on  system  reliability  for 
configurations  of  series/parallel  circuits.  General  configurations  of  non- 
repeated  and  repeated  components  are  examined  and  a method  for  unpooling  data 
is  discussed.  A technique  is  derived  for  representing  ""m  out  of  nwA^eclsion 
logic  gates.  The  methodology  is  applied  to  an  example  of  the  type  of  a 

sophisticated  weapon  fuzing  system.  Maximum  likelihood  estimates  of  relia- 
bility and  9 0%  lower  confidence  bounds  are  calculated  for  the  system  and 
critical  components  are  identified.  

1.  INTRODUCTION.  For  critical  and  expensive  weapon  systems,  such  as 
nuclear  projectiles,  highly  reliable  subsystems  are  required  to  produce  a high 
probability  of  successful  system  performance.  Not  only  must  the  reliability 
of  these  integral  subsystems  be  very  high,  but,  since  often  relatively  few  of 
such  weapon  systems  will  be  used  to  attack  an  enemy  target,  there  must  also  be 
a high  degree  of  confidence  that  such  reliability  will  be  achieved.  This 
report  describes  a general  methodology  for  calculating  maximum-likelihood 
estimates  of  reliability  as  well  as  90-percent  lower  confidence  bounds  on  the 
system  reliability  for  general  systems  representable  aE  configurations  of 
series/parallel  circuits. 


In  testing  these  weapon  systems,  because  of  the  scarcity  and  cost  of 
some  of  the  components,  the  tester  must  be  quite  selective  in  the  number  and 
type  of  subsystems  to  be  included  in  field  tests.  An  important  byproduct  of 
the  methodology  to  be  presented  is  that  it  evinces  those  components  that  are 
critical,  in  that  they  constrain  the  lower  confidence  bounds,  and  those  that 
are  not.  Therefore,  it  would  be  highly  cost-effective  to  schematize  the  sys- 
tem in  the  format  of  this  methodology  before  testing  has  begun,  so  that  the 
test  director  can  effectively  allocate  his  test  resources  to  the  critical 
components. 


m 
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The  next  section  discusses  the  methodology  for  calculating  confidence 
bounds  on  circuit  system  reliability  in  a completely  general  way.  It  is  hoped 
that  this  section  will  serve  as  a handy  reference  to  the  analyst  who  desires 
to  make  confidence-bound  determinations  for  many  types  of  circuit  systems. 
For  example,  the  methodology  should  be  readily  applicable  to  various  kinds  of 
sensors,  radars,  and  miSBlle  guidance  systems.  In  later  sections,  the  method- 
ology is  applied  to  a system  of  the  type  of  an  actual  weapon  fuzing  system. 
Based  on  simulated  test  data,  90-percent  lower  confidence  bounds  on  system 
reliability  are  calculated  and  critical  components  are  identified. 
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2.1  EVALUATION  OP  CONFIDENCE  BOUNDS.  By  a 90-percent  lower  confidence 
bound  on  system  reliability  la  aeant  a statistic  computed  from  the  test  data 
with  the  property  that  there  la  at  least  a probability  of  0,90  that  this 
statistic  is  lower  than  the  unknown  system  reliability.  Under  the  assumption 
that  tests  on  a component  are  binomial , that  Is,  the  tests  are  independent 
with  constant  failure  probability,  the  90-percent  lower  confidence  bound, 
LCB^q,  on  component  reliability  is  computed  as  follows  when  the  test  data 
indicate  N tests  with  F failures: 


LCB90  * b90(n,f)  1 — p 


(1) 


where  p satisfies  the  binomial  relationship 

l (?)  P^l  - P)**'1  - 0.90 

i-F+1 

or,  equivalently, 

I (?)  p1U  - p)N_1  - 0.10  . 

1-0 

These  formulas  assume  that  N and  F are  integers;  in  calculating 
equivalent  components  later,  there  will  be  a need  for  evaluating  90-percent 
lower  confidence  bounds  when  N and/or  F are  not  integral.  In  this  case,  the 
following  linear  interpolation  formula  is  useful: 


B,0(».F)S  (1  - HoJHi  - r0)B, Fr)  ♦ F^Nj.Fj  ♦ 1)1 

(2) 

+ “D[(‘  - W"i  * ‘•Fi>  * fd%>(si  * ‘•FI  * 01 


whe  re 
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f - ’ 
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tr 


Nj  - [Hj , the  integer  part  of  N, 

ND  - N - IN], 

Ft  ■ IF] , the  integer  part  of  F,  and 
Fd  - F - |F] . 
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Tables  (1]  are  available  from  which  binomial  confidence  bounds  can  be 
read  for  N • 1 Co  150.  In  the  calculation  of  equivalent-system  lower 

confidence  bounds  later  in  this  paper,  we  shall  frequently  encounter  very 
large  values  of  N together  with  very  small  values  of  F.  To  obtain  such  lower 
confidence  bounds,  the  Poisson  approximation  to  the  binomial  is  used  when  N > 
150  and  F < 10.  As  long  as  F is  an  integer,  regardless  of  whether  or  not  N is 
an  integer,  the  Poisson  estimate  is  given  by 


P90(F)55  2 X0.90(2F  + 2) 


(3) 


. •*  * ' 
'.V.N 


where  x_  9^(2F  + 2)  denotes  the  90th  percentile  of  a chi-6quare  distribution 
with  2r  V 2 degrees  of  freedom.  Tables  of  the  chi-square  percentiles  can  be 
found  in  many  statistics  textbooks  (see  {2]).  When  F is  not  an  integer, 
P(jq(F)  may  be  calculated  by  linear  Interpolation: 


VF)“  (*  - + WFi + » 


(4) 


u'\. 

C-*.* 


r- 


In  either  case,  the  90-percent  lower  confidence  bound  is  then  estimated  from 
the  formula 


P90(F) 

LCB90  ‘ B90(N’F)  " 1 “ “T 


(5) 


Another  useful  formula  for  calculating  component  lower  confidence  bounds 
arises  from  the  observation  that,  when  F » 0 in  equation  (1),  we  have 


[b9o(n,°)]  N - (1  - p)N  - 0.10 


which  leads  to  the  exact  solution 


B90(N,0) 


(0.10) 


1/N 


(6) 


It  should  be  clear  that  all  the  preceding  formulas  can  be  readily 
extended  to  the  computation  of  component  lower  confidence  bounds  at  other  than 
the  90-percent  level. 

The  next  several  sections  describe  techniques  for  calculating  lower  con- 
fidence bounds  for  general  series  and  parallel  configurations  of  components. 
These  procedures  are  taken  from  those  recommended  by  a special  Working  Group 
chaired  by  the  Army  Materiel  Systems  Analysis  Activity  [3). 


2.2  CALCULATION  OF  CONFIDENCE  BOUNDS  FOR  A SERIES  SYSTEM  OF 
NONREPEATEP  COMPONENTS.  The  simplest  case  is  a system  whose  configuration 


consists  of  a series  arrangement  of  independent  components,  as  exemplified  in 
figure  1. 


/■: 
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Test  Data:  N1  Tests  N2  Tests  Nj  Tests  Tests 

S<  Successes  S2  Successes  S;  Successes  Successes 

Fi  Failures  F2  Failures  Fj  Failures  F^  Failures 

Figure  1.  Series  system  of  nonrepeated  components. 


None  of  the  ^ components  in  this  series  are  repeated;  that  is,  all  are 
independently  functioning  components  which  appear  only  once  and  have  specific 
test  data  in  terms  of  observed  successes  and  failures.  Note  that  = 

for  all  values  of  i. 

The  lower  confidence  bound  on  the  reliability  of  this  series  is  obtained 
by  reducing  the  combination  to  an  equivalent  component.  This  is  done  by  means 
of  the  Linds trom-Madden  method  [4]  which  calculates  the  maximum-likelihood 
estimate  of  the  system  reliability,  Rg,  by  the  formula 


• n r 

i=1  Ni 


and  takes  the  equivalent  number  of  tests,  N,  for  the  system  to  be 


N = min 

1 (8) 

The  equivalent  number  of  successes  and  failures  of  the  system,  S and  F respec- 
tively, are  then  given  by 


s - NR8  , (9) 

F - N(l  - Rs)  . (10) 

Thus  the  series  combination  is  now  represented  by  a single  equivalent 
component  with  S successes  and  F failures  out  of  N tests.  The  90-percent 
lower  confidence  bound  for  the  series  combination  can  now  be  computed  by  the 
methods  of  section  2.1. 

For  example,  consider  the  three  components  in  series  in  figure  2. 
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Component  1 


Component  2 


Component  3 


H1  = 25 
Si  = 25 
Ft  r=  0 


N2  “ 50 
S2  = 48 
F 0 = 2 


N3  = 63 
S3  = 63 
F3  !=  0 


Figure  2.  Example  of  series  system. 


The  computational  procedure  gives  the  following: 

Step  1.  Rs  * 1 x 3§‘  x 1 " 0,96 
Step  2.  N - min(25,  50,  63)  - 25 

Step  3 . S » 0.96(25)  - 24 
F - 0.04(25)  - 1 

Step  4.  LCB9q  - B9Q(25,  1)  - 0.853  (from  eq  ( 1 ) and  table  lookup) 


2.3  CALCULATION  OF  CONFIDENCE  BOUNDS  FOR  A PARALLEL  SYSTEM  OF 
NONREPEATED  COMPONENTS.  For  a system  configured  as  in  figure  3 with 

independent,  nonrepeated  components  in  parallel,  an  equivalent  single 
component  is  again  derived.  The  equivalent  number  of  teats,  N,  la  computed 
from  the  equation 


Component 

1 

N,.  Sv  F 1 

Component 

2 

N2.  s2.  f2 

Component  ] 


where 


1 - Q' 
qf—t-q  / 


n i ■ 


NrSi.F, 


Component 

. U 

Nj  = Number  of  Tests 
Sj  = Number  of  Successes 
Fj  = Number  ol  Failures 

Figure  3.  Parallel 
system  of  nonrepeated 
components . 


Fi  * 1 
N.  + 1 


and  the  maximum  likelihood  estimate  of  the  system 
reliability  is  then  given  by: 

R8  - 1 - Q • 02) 

The  equivalent  numbers  of  successes  and  failures  are  then 
derived : 


~ 8 * 
F - NQ  . 


< 
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The  90-percent  lower  confidence  bound  for  the  system  reliability  can  now  be 
computed  as  that  for  the  equivalent  single  component  with  F failures  out  of  N 
tests. 


An  example  of  a parallel  system  Is  given  In  figure  4.  The  computational 
steps  proceed  as  follows: 

Step  1.  Q "Ox  — x ~ » 0 

Step  2.  q'-i^.x|px-|p  - 0.000838 

Step  3.  N - qv\%  “ 1192.5 

Step  4.  Rs  - 1 

Step  5.  S - 1192.5 

F - 0 

Step  6.  LCB9q  - B90(1192.5,  0)  - (0. 10)1/U92,5  - C.9981 

(from  eq  (6)) 


Component  1 


r. 

o 

V-  O 

II  II 

* iT 

n 

Component  2 

N2  = 20 
F2  = 2 

-\ 

Component  3 

L_ 

N3  =30 

f3  = i 

Figure  4. 


Example  of  parallel  system. 


2.4  CONSTRUCTION  OF  AN  EQUIVALENT  COMPONENT  WITH  SPECIFIED  RELIABILITY 
AND  CONFIDENCE  BOUND.  In  reducing  a complex  combination  of  components  to  an 
equivalent  single  component,  a sequence  of  substitutions  may  be  required.  It 
may  occur,  in  the  techniques  to  be  developed  In  subsequent  sections,  that  some 
reductions  will  calculate  the  maximum-lllcellhood  estimate  of  reliability  as 
well  as  the  lower  confidence  bound  for  a subsystem  without  specifying  the 
equivalent  test  data.  Therefore,  it  will  be  useful  in  the  sequel  to  have  a 
technique  for  constructing  the  equivalent  test  data  for  a subsystem  when  given 
only  the  maximum-likelihood  estimate  of  reliability,  R,  and  the  90-percent 
lower  tonfldence  bound,  B9q. 

The  technique  for  solving  for  the  equivalent  number  of  tests,  N,  and 
failures,  F,  given  R and  B^q,  is  actually  just  the  solution  of  the  following 
two  equations  in  two  unknowns: 


F 


’90 


* B9q(N,F) 


-\\\ 


- .*•  . * •'*  . • . ' **  »v* » * * ' •'*  f»v  •** 

^ • «-•  V V s'.n-.v.'«-Va,v 


.V 
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However,  the  second  of  these  equations  cannot  be  solved  explicitly,  so  an 
iterative  approach  to  solution  is  used. 

The  iteration  begins  with  an  initial  estimate  of  N,  denoted  by  Np 
calculated  from  the  formula 


N 


1 


In  0.10 
TiTBgQ 


(15) 


If  the  reliability  estimate  R is  equal  to  l,  set  N ■ Nj  and  F = 0.  If  not,  an 
estimate  of  F,  denoted  by  Fp  is  obtained  from 


F,  = <1  - RJN,  , (16) 

and  the  confidence  bound  B^NpF.)  is  determined  by  the  techniques  in  section 
2.1.  An  adjustment  factor  given  by 


t 


In  B 


90 


(NVFJ 


In  B 


90 


(17) 


is  used  to  obtain  the  next  estimate  of  N,  denoted  by  N2*. 


n2  = tN1  . (18) 

If  the  adjustment  factor  is  near  enough  to  1 (i.e..  It  - ll  < 0.01),  then  use 
N = N2  and  F » (1  - R)N2  as  the  equivalent  test  data.  If  not,  N2  is  taken  as 
the  estimate  of  N and  the  above  process  (eq  (16)  through  (18))  is  repeated 
until  the  adjustment  factor  converges  close  enough  to  1,  resulting  in  the 
equivalent  values  of  N and  F.  This  procedure  is  illustrated  in  the  next 
section. 

2.5  CALCULATION  OF  CONFIDENCE  BOUNDS  FOR  A SYSTEM  CONSISTING  OF  ONLY  A 
SINGLE  COMPONENT  REPEATED  IN  ANY  CONFIGURATION . This  section  describes  the 
methodology  to  be  used  for  calculating  confidence  bounds  for  a system  or 
subsystem  which  is  a combination  of  series  and/or  parallel  circuits  composed 
solely  of  repetitions  of  the  same  component.  More  precisely,  the  components, 
although  separate  physical  devices,  are  Che  same  in  the  sense  that  they  are  of 
the  same  generic  type  and  are  described  by  the  same  test  data. 

Suppose  the  system  to  be  analyzed  Is  a series/parallel  configura- 
tion consisting  of  repetitions  of  a component,  C,  characterized  by  test  data 
indicating  Fc  failures  in  Nc  tests.  The  maximum-likelihood  estimate  for  the 
reliability  of  the  component,  C,  is  given  by 


R = 1 

c 


(19) 
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Analysis  of  Che  system  Into  its  series  and  parallel  branches  of  C components 
gives  rise  to  a reliability  estimate  for  the  system  which  is  a function  of  Rc: 


I 

I 


Rs  » f(Rc)  . (20) 

For  example^  if  the  configuration  consisted  of  n components  C in  series,  f(R  ) 
would  bo  R , whereas  if  the  configuration  were  n components  C in  parallel, 
f ( Rc ; woul<f  be  1 - (l  - Rc)n. 

To  calculate  confidence  bounds  for  the  general  series/parallel 
configuration  of  C components,  the  methodology  begins  by  evaluating  the  90- 
percent  lower  confidence  bound  for  C: 

= B9o(Nc'Fc)  * 


The  90-percent  lower  confidence  bound  for  the  system,  LCBg,  is  then  calculated 
by  means  of  the  function  in  equation  (20): 


LCBs  = f(LCBc)  . (21) 

Therefore,  we  have  obtained  the  maximum-likelihood  estimate  of  reliability  (eq 
(20))  and  the  90-percent  lower  confidence  bound  (eq  (21))  for  the  system. 
Equivalent  test  data  for  the  system  (that  is,  Ng  and  Fs)  can  now  be  calculated 
by  the  method  of  section  2.4, 


For  the  special  case  where  the  configuration  of  the  system  is 
just  a series  arrangement  of  n repeats  of  C and  where  F is  small  compared  to 
Nc  (that  is,  Fc  < Nc/10),  two  simple  but  accurate  approximations  for  Ng  and  Fg 
are  available.  Both  of  these  approximations  are  conservative  in  that  they 
tend  to  underestimate  N„: 

O 


Approximation  1 : 


n 


(22) 


Approximation  2: 


F = 


8 


0 - rsK 


(23) 

(24) 


F 


s 


(’  - RsK 


= F_ 


(25) 


Note  that  the  second  approximation  cannot  be  used  when  R ■ 1 (or, 
equivalently,  Fc  - 0),  but  In  this  case  the  first  approximation  yields  exactly 
the  same  values  as  the  general  method  in  section  2.4,  since 


In  0.10 
In  LCB_ 


In  0.10 
In  LCB" 


Ln  0.10 


In  0.10 

1 

n ln  (0.10) 


from  equation  (15) 


from  equation  (6) 


These  approximations  are  often  useful  in  the  reduction  of  a complex  eystera 
with  series  subsystems  to  an  equivalent  system. 

As  an  example,  consider  the  series/parallel  configuration  in 
figure  5,  where  Nc  ■ 15  and  Fc  * 1.  Computations  proceed  as  follows: 


Step  1.  = 1 - VT  “ 0.93333 

c ib 

Step  2.  Rs  - [l  - (l  - Rc)2][l  - (l  - Rc)3]  = 0.99526 
Step  3.  LCBc  - B90(15,  1)  - 0.7643 

Step  4.  LCBg  - (l  - (1  - LCBc)2}[1  - (l  - ICBj3]  - 0.93206 

Step  5.  The  iterative  method  of  section  2.4  with  R - 0.99526  and 
Bqq  “ 0.93206  Chen  gives  the  following  table,  where  the 
Bqa(N 1 ,F. ) values  are  obtained  by  the  interpolation 
formula  (2). 


Iteration 


B90^N1 ,F1 


l 

32.73 

0.155 

0.9247 

1.112 

36.42 

2 

36.42 

0.173 

0.9314 

1.011 

36.81 

3 

36.81 

0.174 

0.9320 

0.9997 

36.80 

s s s vs 


Figure  _>.  Seriea/parallel  config- 
uration. 


Consequently,  the  equivalent  test  data  for  the  system  are  given 


N8  - 36.80 

Fs  “ (1  * r8)n8  " 0-174  . 

2.6  CALCULATION  OF  CONFIDENCE  BOUNDS  FOR  GENERAL  CONFIGURATIONS — METHOD 
FOR  UNPOOLING  DATA.  The  techniques  discussed  so  far  permit  the  calculation  of 
lower  confidence  bounds  on  system  reliability  for  series/parallel  systems  of 
Independent,  nonrepeated  components,  as  well  as  for  systems  which  contain 
repeated  component  types,  as  long  as  each  repeated  component  appears  in  only 
one  subsystem.  In  order  to  handle  configurations  in  which  repeated  components 
are  distributed  throughout  several  subsystems  in  combination  with  other 
repeated  or  nonrepeated  components,  a method  will  be  described  for  unpooling 
the  data  for  repeated  components.  This  method  divides  the  component  test  data 
into  groups  corresponding  to  the  various  subsystems  in  which  the  component 
appears,  and  then  treats  the  component  as  distinct  and  independent  within  each 
subsystem.  It  has  been  found  that  such  unpooling  schemes  provide  somewhat 
conservative  lower  confidence  bounds  on  reliability. 


The  basic  idea  behind  the  unpooling  method  is  as  follows.  Sup- 
pose C is  a component,  with  test  data  indicating  F£  failures  in  Nc  tests, 
which  occurs  in  n subsystems,  where  the  subsystems  are  chosen  to  each  contain 
as  many  appearances  of  C as  possible  and  still  be  analyzable  by  the  techniques 
of  sections  2.2  through  2.5.  Thus  each  subsystem  either  contains  just  one 
appearance  of  C or,  if  it  contains  two  or  more  appearances,  that  portion  of 
the  subsystem  can  be  reduced  to  a configuration  composed  of  repetitions  of  a 
single  equivalent  component.  The  component  C will  be  relabeled  as  C^,  Co. 
...,  Cn,  respectively,  for  each  of  the  n subsystems  in  which  it  appears.  Tne 
test  data  for  C is  then  allocated  over  the  n subsystems  in  such  a way  as  to 
keep  the  maximum-likelihood  estimate  of  reliability  for  each  C^,  i - 1,  2, 
n,  equal  to  that  for  C.  That  is,  the  constraints  on  the  unpooling  are 


n 


for  i = 1,  2, 


* • • / 


n 


There  are  many  ways  of  unpooLlng  which  satisfy  these  constraints. 
The  method  used  here  unpools  according  to  the  following  scheme: 

(1)  Unpool  equally  in  a series  direction. 

(2)  Then  unpool  equally  in  a parallel  direction. 

(3)  Then  unpool  equally  in  a series  direction. 

etc 

This  sequence  is  best  illustrated  by  an  example,  as  shown  in  figure  6.  In 
this  system  the  component  C appears  in  four  subsystems  and  has  been  relabeled 
accordingly.  The  first  step  of  the  unpooling  would  allocate  N /2  and  Fc/2  to 
Cj  and  the  other  Nc/2  and  F /2  to  the  parallel  combination,  since  there  are 
two  branches  in  parallel,  tne  second  step  of  the  unpooling  would  divide  in 
half  the  equivalent  test  data  for  the  parallel  combination,  thus  allocating 
Nc/4  and  Fc/4  to  and  the  other  Nc/4  and  Fc/4  to  the  series  combination 

containing  and  C-j,  In  turn  the  third  step  of  the  unpooling  allocates  Nc/8 
and  Fc/8  to  each  or  Cy  and  C^.  In  summary,  the  unpooled  test  data  for  each 
appearance  of  C would  be  as  follows. 


Component 

Test 

data 

N 

F 

C1 

V2 

Fc/2 

C2 

Nc/8 

Fc/8 

C3 

V8 

o 

00 

C4 

V4 

V4 

Total: 

Nc 

Fc 

After  unpooling,  each  of  the  C^'s  is  treated  as  a separate,  independent  compo- 
nent and  the  techniques  in  sections  2.2  through  2,5  are  applied,  as  appropri- 
ate, to  each  of  the  subsystems. 


Figure  6.  Example  of  unpooling  scheme 
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2.7  REPRESENTATION  OF  "TWO  OUT  OF  THREE”  DECISION  GATE.  Synthesis  of 
the  techniques  presented  so  far  enables  one  to  calculate  lower  confidence 
bounds  on  reliability  for  any  series/parallel  configuration.  However,  many  of 
the  sophisticated  circuits  of  today  contain  other  configurations,  such  as 
decision  gates,  to  gain  greater  reliability  and  efficiency.  A jtraightforward 
procedure  will  be  formulated  to  handle  decision  gates  by  approximate 
equivalent  combinations  of  series  and  parallel  circuits. 

The  methodology  will  be  illustrated  for  a "two  out  of  three"  decision  gate; 
the  extension  to  general  "k.  out  of  m"  decision  logic  gates  should  be  clear. 

First,  observe  that  for  a series  combination  of  components  Cj , 
^2*  • ••»  with  component  failure  probabilities  , . ...  , the 

failure  probability  of  the  combination,  Q,  is  given  by  1 2 K 

S ■ ’ - (’  - «=,)(’  ' - (’  - *k) 

= + CU  + . . . + Qp  + second  and  higher  order  terms 

-c,  m_2 

Mission  reliability  equations  for  modern  weapon  systems  typically  neglect  the 
second  and  higher  order  terms  and  simply  add  together  failure  probabilities  of 
components  in  series.  On  the  other  hand,  if  Cj , Co,  ....  (^  were  in  parallel, 
the  failure  probability  for  the  system  would  be,  simply, 


2 = **  * * 

For  a decision  gate  configuration  which  requires  success  in  two 
(or  more)  of  the  three  branches  (with  each  branch  consisting  of  the  same 
component  C)  for  a YES  vote,  the  probability  of  failure,  Q,  of  the  gate  (i.e., 
a NO  vote)  is  given  by 


Q ■ probability  that  2 or  3 branches  fail 
» 3Q2  + q3  f 

where  Qc  is  the  failure  probability  of  the  component  C,  In  terms  of  failure 
probability,  the  decision  gate  is,  therefore,  approximately  equivalent  to  the 
series/parallel  combination  shown  in  figure  7,  which  has  a failure  probability 
given  by 


+ fourth  and  higher  order  ter®  . 


Since  the  terms  omitted  by  introducing  this  approximation  are  two  orders  less 
than  those  already  typically  neglected  in  the  mission  reliability  equation, 
this  series/parallel  combination  should  afford  a sufficiently  accurate  repre- 
sentation of  the  decision  gate. 


Figure  7.  Decision  gate 
approximate  equivalent  com- 
bination. 


3.  CASE  STUDY  - APPLICATION  OF  THE  METHODOLOGY.  The  methodology 
described  in  the  previous  sections  will  now  be  applied  to  an  example  based  on 
the  actual  fuzing  system  of  a battlefield  weapon.  The  system  schematic,  shown 
in  figure  8,  is  at  the  same  level  of  sophistication  as  the  fuzing  system. 
However,  for  purposes  of  keeping  this  report  unclassified,  a few  modifications 
have  been  made  to  the  actual  schematic  and  simulated  component  test  data  is 
u9ed.  Note  the  "two  out  of  three"  decision  gate  equivalent  in  the  upper  right 
hand  part  of  the  system  schematic  in  figure  8.  The  simulated  component  test 
data  is  displayed  in  table  1.  For  some  of  the  components  only  a reliability 
value,  R,  is  available,  presumably  based  on  a large  number  of  tests  by  the 
manufacturer;  such  components  are  denoted  by  an  asterisk  in  figure  8. 

The  lower-confidence-bound  computation  for  this  system  will  proceed 
through  two  reductions  of  the  system,  unpooling  into  subsystems  and  calcula- 
tion of  equivalent  components,  and  then  the  calculation  of  the  system  lower 
confidence  bound  itself.  In  the  process,  components  critical  to  the  confi- 
dence-bound assessment  will  be  evinced  and  pertinent  observations  made. 


In  the  first  reduction  many  of  the  series  combinations  which  are  re- 
peated in  a particular  type  of  configuration  throughout  the  system  schematic 
are  simplified.  The  computations  are  sketched  in  appendix  A,  Note  that  those 
components  which  have  reliability  estimates  only  are  treated  as  having  essen- 
tially an  infinite  number  of  trials;  thus  they  do  not  affect  the  calculation 
of  the  equivalent  component  N (number  of  trials)  but  only  the  calculation  of 
the  equivalent  component  R (reliability).  After  the  first  reduction,  the 
system  schematic  takes  the  form  shown  in  figure  9. 


i*>n 


The  primary  function  of  the  second  reduction  is  to  consolidate  the  long 
series  of  components  at  the  oeginning  of  the  schematic  in  figure  9.  After 
these  substitutions  are  made,  the  reduced  schematic  assumes  the  tractable  form 
shown  in  figure  10*  Details  of  the  reduction  procedure  are  given  in  appendix 
8. 


The  reduced  schematic,  divided  into  subsystems  as  shown  in  figure  10, 
can  now  be  treated  by  applying  the  methodology  developed  previously  to  each  of 
the  numbered  subsystems  and  then  determining  the  equivalent  N and  R for  the 
overall  series  configuration  of  subsystems.  However,  the  data  must  first  be 
unpooled  for  components  which  appear  in  more  than  one  subsystem.  The  compo- 
nents which  appear  in  the  reduced  schematic,  before  unpooling,  are  listed  in 
table  2 along  with  their  equivalent  test  data.  The  equivalent  test  data  after 
unpooling  are  shown  in  table  3.  Note  that  those  components  which  appear  in 
more  than  one  subsystem  have  had  an  extra  subscript  appended  to  indicate  those 
repetitions.  (For  example,  V13,  refers  to  the  third  distinct  appearance  of  Vj, 
in  the  top  branch  of  subsystem  6.) 


The  equivalent  number  of  trials,  N,  and  the  maximum-likelihood  reliabil- 
ity estimate,  R,  are  computed,  subsystem  by  subsystem,  in  appendix  C and  tabu- 
lated in  table  4,  Since  the  overall  system  configuration  is  nou  represented 
as  a series  combination  of  these  subsystems,  the  maximum-likelihood  estimate 
of  the  overall  system's  reliability  is  juBt  the  product  of  the  subsystem  reli- 
abilities (R  - 0.9824),  and  the  equivalent  number  of  trials  is  the  minimum  of 
those  for  the  subsystems  (N  ■ 165).  This  minimum  number  (indicated  by  an 
asterisk  in  table  4)  corresponds  to  the  critical  subsystem — that  which 
delimits  the  equivalent  number  of  trials.  Note  how  only  a few  subsystems,  and 
thus  only  a few  components,  may  determine  the  calculation  of  the  confidence 
bound.  Examination  of  the  critical  subsystem  8 identifies  the  critical 
component  of  the  overall  system  (i.e»,  that  component  for  which  additional 
test  data  could  Increase  the  equivalent  number  of  trials  for  the  overall 
system  and  hence  Improve  the  resulting  lower  confidence  bound  ),  to  be  the  Z 
component. 
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TABLE  2.  EQUIVALENT  TEST  DATA 


Component 


Huabtt  of  Trt»l» 


Q 

» 

S 

T 

V1 

Z 

1 


192 

573 

570 

572 

250 

328 

383 

92 


3.130 

L'- 

0 

!/' 

(.■' 

0 

K- 

0 

i..- 

t 

0 

* 

r 

L. 

0.3333 

v.\ 

0.3333 

V*. 

v'. 

0.3333 

i.’ 

0 

•.'i 

5 

r* 

5 

£ 

5 

< 

r- 

0.3333 

k* 
^ . 

0.3333 

4 m% 

0.3333 

0.24925 

r 

0.24925 

i * 

0.124625 

f. 

y: 

0.126625 

»* , 

if” 

0.24925 

[-• 

0 ^ 
0 
0 
0 
0 


J "Ti.'  V s’ \vv,' 


The  data  are  now  In  place  to  calculate  the  90-percent  lower  confidence 
bound  on  the  reliability  of  this  example  system.  We  have: 

R - 0.9824 

N - 165 

F - (l-R)N  - 2,904 

The  interpolation  formula  (2)  and  the  Poisson  estimate  (3)  give  the  90-percent 
lower  confidence  bound: 


LCB  = 0.096  B90(165,  2)  + 0.904  B90(16S, 

/ 7 *0.90<6)\  / 

= 0.096  U J + 0.904 

= 0.096(0.96788)  + 0.904(0.95939) 

= 0.9602 


Note  that  R is  a point  estimate  of  the  reliability  of  the  system,  whereas  the 
lower  confidence  bound  is  a bound  on  the  unknown  actual  system  reliability, 
not  on  the  point  estimate. 

In  summary,  the  general  methodology  described  in  this  report  has  been 
utilized  to  estimate  the  system  reliability  of  a practical  weapon  system 
design,  to  obtain  a 90-percent  lower  confidence  bound  on  the  system  relia- 
bility, and  to  determine  those  system  components  which  are  prime  candidates 
for  further  design  tests. 
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APPENDIX  A 


FIRST  REDUCTION 


In  each  replacement  of  a subsystem,  shown  in  figure  8 in  the  body  of  the 
report,  by  an  equivalent  component,  both  the  original  subsystem  and  the  new 
equivalent  component  will  be  depicted.  The  methodology  used  for  the  reduction 
will  be  referred  to  by  the  appropriate  section  in  the  body  of  the  report.  The 
symbols  N,  F,  R,  and  Q will  be  used  throughout  to  denote  number  of  tests, 
number  of  failures,  maximum  likelihood  reliability  estimate,  and  failure 
probability,  respectively. 


Original  subsystem 


Equivalent  component 


nh  = 401 

fh  = 0 

RH  - 1 


(method  of  N - 200.5 

H1 

sect.  2.5,  F ■ 0 

H1 

N (22)) 


1 


(0.03)2  - 0.0009 


Qj  = 0.03 


Original  subsystem 


Original  subsystem 


Equivalent  component 


Rh  - 0.999  Ng  - 1260 


F.f  “ 0 


(method  of 
sect.  2.2) 


-jQ1  (method  of 

Nn  - 381 

F „ 0 sect.  2.2) 


N0  » 381  Nt  = 399 


F0  - 0 


Nk  » 371  = 375 


(method  of 


Na  = 371 


sect.  2.2)  P _ n 

F0.  53  0 

r»  * I 


*This  warhead  component  is  repeated  in  other  subsystems  but,  since  it  is 
being  treated  as  having  essentialy  an  infinite  number  of  trials,  it  cannot 
affect  calculation  of  the  equivalent  N and  so  it  can  be  treated  as  independ- 
ent, affecting  only  the  calculation  of  R. 


. ' v^-  ' . 


APPENDIX  B 


SECOND  REDUCTION 


In  each  replacement  of  a subsystem,  shown  in  figure  9 in  the  body  of  the 
report,  by  an  equivalent  component,  both  the  original  subsystem  and  the  new 
equivalent  component  will  be  depicted.  The  methodology  used  for  the  reduction 
will  be  referred  to  by  the  appropriate  section  in  the  body  of  the  report.  The 
symbols  N,  P,  R,  and  LCB  will  be  used  throughout  to  denote  number  of  tests, 
number  of  failures,  maximum  likelihood  reliability  estimate,  and  90-percent 
lower  confidence  bound,  respectively. 


Original  subsystem 


Equivalent  component 


; 

A 

5000 

b r 

301  193 

193 

200.  S 0.995 

u 

0.994 

0.9997 

R 

o 

■ 

rB  - o rf  - o 

o 

B 

PH,  “° 

*x  * "j,  “ *x  ■ 

0.9978  0.9991  0.999 


• 0.998999 


(Mthod  of 
Met.  2.2) 


192 

0.98370 

3.130 


(method  of 
sect.  2.5) 


381 

2.992 

0.99215 


10,  961 
0.680 


LCB  » 0.98244  by  the  Poisson  estimate  (eq  (5)) 
ci 

R - 1 - / 1 - r \2  - 0.999938 
C2  \ £1/ 

LCBC  •»  1 - - LCBe^2  » 0.999892 

Th.  iterative  method  of  section  2.4  i.  need  to  find  and  r£j,  ptodocin,  the 
results  in  the  following  table. 


Iteration 

N1 

F1 

b9o(hi*pi) 

t 

n2 

1 

7,475 

0.4635 

0.999593 

1 . 32 

9,878 

2 

9,878 

0.6124 

0.999668 

1.078 

10,648 

3 

10,648 

0.6602 

0.999685 

1.023 

10,890 

4 

10,890 

0.6752 

0.999690 

1.006 

10,961 

From  these 

results. 

N * 

10,961 

t 

e2 

s- 

(’  - 

= 0 • 680  • 

>/  C2 

APPENDIX  C 


ANALYSIS  OF  SUBSYSTEMS 


The  equivalent  number  of  trials  and  the  maximum-likelihood  reliability 
estimate  will  be  calculated  for  each  of  the  10  subsystems  in  the  reduced 
schematic  in  figure  10  in  the  body  of  the  report.  The  methodology  used  for 
each  subsystem  will  be  referred  to  by  the  appropriate  section  in  the  body  of 
the  report.  The  symbols  N,  F,  R,  and  LCB  will  be  used  throughout  to  denote 
number  of  tests,  number  of  failures,  maximum  likelihood  reliability  estimate, 
and  90-percent  lower  confidence  bound,  respectively. 

SUBSYSTEM  1 

This  subsystem  is  a series/parallel  configuration  consisting  of  repeti- 
tions of  a single  series  combination: 


N.,  » 143.25 

N11 


FCl 


190 

0.3333 


I 


Hr  ■ 572 
Fr  - 0 


For  this  series. 


N 

R 

LCB 


143.25 

0.99825 


0.98107  (by  interpolation  formula  (2)  in  the  body  of  the 
report 


For  subsystem  1 (using  the  method  of  sect.  2.5),  we  obtain 

Rj  - [l  - (1  - R) 2 ]3[ 1 - (1  - R)3]  - 0.999991  , 

LCBj  ■ [l  - (1  - LCB)2]3(l  - (1  - LCB)3]  - 0.998918  , 


which  leads  to  the  results  in  the  following  tables 


l 

I 

' Iteration  N1  F1 

1 

| 1 2127  0.0191 

{ 


B 


90 


1,F1 


0. 998905 


1.010  2158 


This  gives  the  final  data  for  subsystem  li 


Nj  - 2158  , 

Rj  - 0.999991  . 


930 


SUBSYSTEM  2 


For  the  upper  series: 


Nm  « 143.25 


Fn  = 0.3333 
*2 


For  the  lower  series: 


Equivalent  N » 143.25 
R =■  0.99825 


Ne  a 83.33 


95.75 


N,  « 1 8. 4 

Z1 


Fv  « 0.24925  F7  « 0 
V11  Z1 


0.0802 


Equivalent  N » 18.4 

R a 0.93662 

For  subsystem  2 (using  the  method  of  sect.  2.3),  we  obtain 


Q - 0.00175  x 0.06338  - 0.0001109  , 


Q-  - 0.000968  , 


nii  - * 1166  ' 


"II  Q'  - Q 

Rjj  » 0.9998891. 


SUBSYSTEM  3 

Subsystem  3 is  the  same  as  subsystem  2 except  that  S is  replaced  by  T. 
A similar  computation  yields 


4u  - 0.9999884  . 


V.V  ‘.«*V  4*.  • AV  V 


. *.  *.  ".  V 
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SUBSYSTEM  4 


For  the  parallel  pain 


By  the  method  of  section  2.3,  we  obtain 


Equivalent  N - 27838  , 

R - 1 . 


Subsysten  4 is  just  this  parallel  pair  repeated  twice  in  series, 
approximation  in  equation  (22),  we  have 


NIV 


27,838 

2 


13,919  , 


RIV 


1 . 


By  the 


SUBSYSTEM  5 


Subsystem  5 is  just  a single  component  repeated  in  parallel: 


By  the  method  of  se^t'o'  2.S  in  the  special  case  where  R » 1,  we  have 


! 


Equivalent  N = 47.875 
R = 0.92918 


For  the  lower  series: 


F •'  «- 

f ' 1 


Equivalent  N - 47.875 
R = 0.98548 

For  subsystem  6 (using  the  method  of  sect.  2.3),  we  obtain 


.V 


Q m 0.0010265 
Q‘  * 0. 00.11 1 59 


1 ~ Q* 
Q'  “ Q 


478  , 


RVI  - 0.9989715  . 


SUBSYSTEM  7 


First  the  series  repetition  of  is  reduced: 


V*  r 

vid 

15 

1 0 

95.75 

0.24925 

0.997397 


i* 

r* 


By  the  approximation  in  equation  (24)  in  the  body  of  the  report,  we  have 

FV 

Equivalent  N • — — * 47.9  , 

1 - Rv 

15 


For  the  upper  series: 


F • 0.24925  . 


c 

v,t 

v., . 

b i 

i 

1 5 

1 D 

- 83.33  N. 


109.33 

0.3333 


N - 47.9 
F - 0.24925 


Equivalent  N ■ 47.9 

R - 0.93226 


. ^ 'J.  V ’.rV  V-V  *«*_'.*  .V.' V.V.  /V'". 


For  the  lower  series: 


m rr~i 

3 

1 3 

N-  ■ 

18.4 

N 

80.2 

z3 

a1  3 

Fz  - 
"3 

0 

0.0802 

Equivalent  N = 18.4 
R * 0.999 


For  subsystem  7 (using  the  method  of  sect.  2.3),  we  obtain 

Q « 0.00006774  , 

Q'  « 0.0045571  , 

NVIt  " 222  » 

Ryjj  » 0.9999323  . 


By  the  method  of  section  2.5  with  R = 1,  we  have 

i 

LCB-  » 0.88230  by  interpolation, 

I-  "4 

v RVIII  * 1 • 

£ ^VIII  ■ 1 ^ * ^CBz^y  » 0.98615, 


Nyjjj  a 165  , 

Rvm  - 1 • 


SUBSYSTEM  9 

For  the  upper  eeriest 


S_  - 80.2 
®14 

F - 0.0802 
°14 

R - 0.999 
®1 4 


By  tlte  pproxieation  in  equation  (24)  in  the  body  of  the  report,  we  have 


Equivalent  N 


40.1  , 


F - 0.0802  . 


For  subsyatee  9 (using  the  eethod  of  sect.  2.3),  we  coebine  the  upper  series 
in  parallel  with  Zj,  which  has  Nz^  - 18.4  and  Fz^  • 0,  and  obtain 


fl  - 0 , 

Q*  » 0.0013548  , 

NIX  - 737  , 


936 


00: 


v\%\ sV-V»'. •. V. l/.V.V.'  - 


^ 

- VV.V/-' 
‘s  "■* 


- . • , - . . - . * - - - - *,  \ %'  *.  *.  *»  *«  „V’  % *»  . 

V o"«.*  '/.vWaVw^ 


SUBSYSTEM  10 


7. 


I 

I 


0.  999 

0.97011  by  interpolation 


The  method  of  section  2.4  is  then  used  to  get  equivalent  test  data,  as 
follows. 


I 


Iteration 

N1 

F1 

b9o(N1 ,F1 ) 

t 

N2 

1 

2577 

0.002577 

0.999104 

1.003 

2586 

These  results  lead  to  the  following  data  for  subsystem  10: 


